Near-eye display having overlapping projector assemblies

ABSTRACT

A display and method for providing an image to an eye of a viewer is provided. The display comprises at least two projector assemblies. Each projector assembly comprises a light-guide optical element (LOE), and an image projector arrangement for generating a partial image and being deployed to introduce the partial image into the LOE for coupling out towards the eye of the viewer. The at least two projector assemblies cooperate to display the image to the eye of the viewer with partial overlap. The display further comprises a controller associated with the image projector arrangements and configured to reduce a pixel intensity of selected pixels in a region of partial overlap between the first and second part of the image so as to enhance a perceived uniformity of the image.

FIELD AND BACKGROUND OF THE INVENTION

The present invention relates to a display and, in particular, itconcerns a display for providing an image to the eye of a viewer.

For applications such as near-eye displays, a projected image having alarge field is desirable. This is typically achieved by injecting alarge field image into a waveguide from a single image projector. Thewaveguide expands the aperture of the projected image, therebyilluminating the eye with a large field image.

However, in order to achieve such aperture expansion, a large projectorand/or large optics are typically required, which is disadvantageous foruse in near-eye displays and other applications where the display mustbe small in order to be useable in the desired application.Additionally, the angular dimensions of the field of view from a givenwaveguide and coupling-out arrangement are limited by geometrical opticsconsiderations such as the range of angles which can be trapped withinthe waveguide so as to propagate by internal reflection, and avoidanceof overlap between an image and its conjugate within the waveguide.

SUMMARY OF THE INVENTION

According to the teachings of the present invention there is provided, adisplay for providing an image to an eye of a viewer, the displayincluding: (a) at least two projector assemblies, each projectorassembly including: (i) a light-guide optical element (LOE) having apair of parallel external surfaces, and (ii) an image projectorarrangement generating a partial image, the image projector arrangementbeing deployed to introduce the partial image from the image projectorarrangement into the LOE so as to propagate within the LOE by internalreflection from the pair of parallel external surfaces, each projectorassembly including a coupling-out arrangement associated with the LOEand configured for coupling out the partial image from the LOE towardsthe eye of the viewer, wherein the LOE of a first of the projectorassemblies is deployed in overlapping relation with the LOE of a secondof the projector assemblies such that the first projector assemblyprojects a first partial image corresponding to a first part of theimage, and the second projector assembly projects a second partial imagecorresponding to a second part of the image, the first and second partof the image having partial overlap so that the at least two projectorassemblies cooperate to display the image to the eye of the viewer; and(b) a controller including at least one processor, the controller beingassociated with the image projector arrangement of at least the firstand second projector assemblies, and configured to reduce a pixelintensity of selected pixels projected by at least one of the first andsecond image projector arrangements, the selected pixels being in aregion of the partial overlap between the first and second part of theimage so as to enhance a perceived uniformity of the image.

According to the teachings of the present invention there is furtherprovided, display for providing an image to an eye of a viewer, thedisplay including: (a) a projector assembly including: (i) a light-guideoptical element (LOE) having a pair of parallel external surfaces, andtwo non-parallel sets of mutually parallel reflective surfaces, the LOEbeing configured for 2D aperture expansion of an image propagatingthrough it, (ii) at least two image projector arrangements generating atleast two partial images corresponding to at least a first part of theimage and at least a second part of the image, respectively, the atleast two image projector arrangements being deployed to introduce theat least two partial images into the LOE so as to propagate the at leasttwo partial images within the LOE by internal reflection from the pairof parallel external surfaces, the projector assembly including acoupling-out arrangement associated with the LOE and configured forcoupling out the partial images from the LOE towards the eye of theviewer, wherein the at least a first part of the image and at least asecond part of the image have partial overlap so that the at least twoprojector assemblies cooperate to display the image to the eye of theviewer; and (b) a controller including at least one processor, thecontroller being associated with the at least two image projectorarrangements, and configured to reduce a pixel intensity of selectedpixels projected by at least one of the first and second image projectorarrangements, the selected pixels being in a region of the partialoverlap between the first and second part of the image so as to enhancea perceived uniformity of the image.

According to the teachings of the present invention there is furtherprovided method of providing an image to an eye of a viewer, including:generating, by a first projector assembly including a first LOE and afirst image projector arrangement, a first partial image correspondingto a first part of the image for coupling out to the viewer; generating,by a second projector assembly including a second LOE and a second imageprojector arrangement, a second partial image corresponding to a secondpart of the image for coupling out to the viewer, wherein the first andsecond LOEs are deployed in overlapping relation such that the first andsecond part of the image are coupled out to the viewer having partialoverlap so that the projector assemblies cooperate to display the imageto the eye of the viewer; determining, by a controller associated withthe first and second image projector arrangements, a subset of pixels ina region of the partial overlap; and reducing, by the controller, theintensity of selected pixels in the subset of pixels, the selectedpixels being projected by at least one of the first and second imageprojector arrangements, so as to enhance the perceived uniformity of theimage.

According to some aspects of the present invention, the display includesat least a third projector assembly, the at least a third projectorassembly including: (i) a LOE having a pair of parallel externalsurfaces, and (ii) an image projector arrangement generating a thirdpartial image corresponding to a third part of the image and beingdeployed to introduce the third part of the image from the imageprojector arrangement into the LOE so as to propagate within the LOE byinternal reflection from the pair of parallel external surfaces, the atleast a third projector assembly including a coupling-out arrangementassociated with the LOE and configured for coupling out the thirdpartial image from the LOE towards the eye of the viewer, wherein theLOE of the at least a third projector assembly is deployed inoverlapping relation with the LOE of at least one of the first andsecond projector assembly such that the at least three projectorassemblies cooperate to display the image to the eye of the viewer,wherein the controller is further associated with the image projectorarrangement of the at least a third projector assembly and configured toreduce a pixel intensity of selected pixels projected by at least oneimage projector arrangement of at least one of the projector assemblies,the selected pixels being a region of partial overlap between at leasttwo parts of the image.

According to some aspects of the present invention, the first partialimage and the second partial image share a set of common pixels, andwherein the selected pixels of reduced intensity are a subset of the setof common pixels.

According to some aspects of the present invention, the controllervaries the selection of the subset of the set of common pixelsresponsively to an overlap region adjustment input.

According to some aspects of the present invention, the overlap regionadjustment input is derived from a pupil position sensor.

According to some aspects of the present invention, the overlap regionadjustment input is derived from a manual user input.

According to some aspects of the present invention, the controller isconfigured to gradually reduce the intensity of the selected pixelsprojected by the first projector arrangement across the region ofpartial overlap, and to gradually increase the intensity of the selectedpixels projected by the second projector arrangement across the regionof partial overlap.

According to some aspects of the present invention, the second projectorassembly includes a second image projector arrangement generating athird partial image corresponding to a third part of the image, andbeing deployed to introduce the third partial image into the LOE of thesecond projector assembly such that the first, second and third parts ofthe image have partial overlap, and wherein the controller is furtherassociated with the second image projector arrangement and configured toreduce a pixel intensity of selected pixels projected by at least oneimage projector arrangement of at least one of the projector assemblies,the selected pixels being a region of partial overlap between at leasttwo parts of the image.

According to some aspects of the present invention, the LOEs of the atleast two projector assemblies are deployed parallel to one another.

According to some aspects of the present invention, the LOEs of the atleast two projector assemblies are deployed non-parallel to one another.

According to some aspects of the present invention, the LOEs aredeployed to extend around or partially encompass the viewer or an eye ofthe viewer, the display further including one or more index-matchedmediums deployed around the viewer between the LOEs forming an opticallysmooth transition with edges of the LOE.

BRIEF DESCRIPTION OF THE DRAWINGS

The invention is herein described, by way of example only, withreference to the accompanying drawings, wherein:

FIG. 1A illustrates schematically projecting a wide field onto aneye-box;

FIG. 1B illustrates schematically projecting a narrow field onto aneye-box;

FIG. 1C illustrates schematically projecting a combination of narrowfields onto an eye-box;

FIG. 2A illustrates schematically a first projector assembly have a LOEand an image projector arrangement;

FIG. 2B illustrates schematically a second projector assembly have a LOEand two image projector arrangement;

FIG. 2C illustrates schematically a display of the present inventionaccording to some embodiments;

FIGS. 2D-2E illustrate schematically a cross-sectional view of theprojector assemblies and coupling-out towards different pupil positions;

FIG. 2F illustrates schematically selected points in the projectedfields in angular space at the first pupil position;

FIG. 2G illustrates schematically selected points in the projectedfields in angular space at the second pupil position;

FIGS. 3A-3E illustrate examples of angular power intensity distributionof projected images;

FIGS. 4A-4C illustrate schematically cross-sectional views of differentconfigurations of a display according to the present invention;

FIG. 5A illustrates schematically a first embodiment of a displayconfigured for 2D image expansion;

FIG. 5B illustrates schematically images combined horizontally;

FIG. 5C illustrates schematically images combined vertically;

FIG. 6 illustrates schematically a second embodiment of a displayconfigured for 2D image expansion;

FIG. 7 illustrates schematically an example functional block diagram ofa display in accordance with certain embodiments;

FIG. 8 illustrates an example flow-chart of a method for displaying animage to an eye of a viewer in accordance with certain embodiments; and

FIGS. 9A-9C illustrate examples of angular power intensity distributionof projected images according to alternative embodiments.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

The present invention provides a display for projecting large fieldimages using small sized optics by projecting a plurality of partial,narrow field images to be combined and viewed by the viewer as a single,large field image.

The term “field” as used herein should be understood to refer to thefield of view of a projected image. The term “eye-box” as used hereinshould be understood to refer to the general area where a pupil isexpected to be while viewing an image. It is expected that the actualpupil position within the eye-box will vary across different viewers(e.g. based on interpupillary distance (“IPD”)), and even for a givenviewer at different times (e.g. based on eyeball rotation).

The principles and operation of the display according to the presentinvention may be better understood with reference to the drawings andthe accompanying description.

Referring now to the drawings, FIG. 1A illustrates schematicallyprojecting a wide field onto an eye-box. Image generator 10a transmitslight rays onto optics 12 a that collimate the light rays and illuminateeye-box 14. As apparent from FIG. 1A, to generate an image with a largefield, optics 12 a must be relatively large. As also apparent from FIG.1A, a substantial amount of light rays 16 a transmitted through optics12 a fall outside eye-box 14 and hence are “wasted” in the sense ofbeing unviewable by the pupil.

FIG. 1B illustrates schematically projecting a narrow field onto aneye-box. For a narrow field, image generator 10 b and optics 12 b can besmaller compared to the image generator and optics required to project alarge field (as in FIG. 1A). Additionally, most of the collimated lightrays reach eye-box 14, with fewer light rays 16 b falling outside theeye-box 14 relative to FIG. 1A. However, the field will be relativelynarrow as compared to that of FIG. 1A, (and also narrower than aperson's natural view of the world) leaving the viewer with a less thandesirable image viewing experience.

FIG. 1C illustrates schematically projecting a combination of narrowfields onto an eye-box. A plurality of image generators 10 c are used incombination with one another, with each individual image generatorprojecting a narrow field partial image such that the final imagereaching eye-box 14 is a much wider field image. As apparent from FIG.1C, image generators 10 c and optics 12 c can be small (as in FIG. 1B),leading to fewer light rays 16 c that fall outside eye-box 14, yet theviewer still advantageously views a wide field image, i.e. the combinedplurality of narrow field partial images. In FIG. 1C the dashed linesrepresent overlapping image data (dashed from center image generator anddot-dashed from left generator) that is preferably implemented in orderto generate a perception of continuity to the observer. Because ofphysical limitations, this overlap cannot be generated by conventionaloptics without cross obscuration. According to an aspect of thisinvention, a light-guide optical element (“LOE”) (also referred toherein as a “waveguide”) is used to generate this overlap withoutobscuration. The waveguide has a pair of parallel external surfaces fortotal internal reflection of light rays introduced to it. Imageprojection and combination

FIG. 2A illustrates schematically a first embodiment of a projectorassembly 5 a have a LOE 28 a and an image projector arrangement 20 a.The image is shown as dashed lines representing lights rays. Imageprojector arrangement 20 a generates and projects a partial image, andcouples the partial image into waveguide 28 a. In some embodiments, theimage projector arrangement includes a light source, spatial lightmodulator (such as a liquid crystal on silicon, or “LCOS”) andcollimating optics. These components may advantageously be arranged onsurfaces of a number of beam splitter prisms, for example, polarizedbeam splitter (PBS) cubes, as is known in the art.

Image projector arrangement 20 a is deployed to introduce the partialimage into the waveguide so as to propagate the partial image within thewaveguide by internal reflection from the pair of parallel externalsurfaces. The introduction of the partial image into the waveguide isachieved via a suitable optical arrangement, referred to as acoupling-in arrangement, which typically includes a prism with suitablyangled surfaces associated with a side edge of the LOE or one of themajor surfaces of the LOE and/or one or more coupling-in reflectorswhich may be located within the LOE or associated with one of thesurfaces thereof. Details of the image projector arrangement, includingthe coupling-in arrangement, are omitted from the schematic drawings forsimplicity of presentation of the invention. A coupling-out arrangement7 a (shown as dashed rectangles on the LOE) associated with LOE 28 a isdeployed to couple-out the partial image from the waveguide towards theeye of the viewer.

In some embodiments, the projector arrangement 20 a can be a wideoptical arrangement, or may include a distinct optical arrangement forlateral aperture expansion. The coupling-out arrangement 7 is typicallyimplemented as one or more sets of obliquely-angled, mutually-parallelinternal partially reflecting surfaces, or as a diffractive opticalelement, all as is known in the art. The general region of the LOE fromwhich the image illumination is coupled-out towards the eye of theviewer is designated by dashed lines.

FIG. 2B illustrates schematically a second embodiment of a projectorassembly 5 b have a LOE 28 b and two image projector arrangements 20 b 1and 20 b 2. The two image projector arrangements 20 b 1 and 20 b 2generate and project distinct partial images (shown as dashed linesrepresenting lights rays). The partial images are coupled-in towaveguide 28 b, such that each partial image is coupled-out (viarespective coupling-out arrangements 7 b 1 and 7 b 2) towards theviewer. The partial images are coupled-in to waveguide at differentangles relative to the waveguide so that coupled-out images do notoverlap. It is apparent from FIG. 2B that there is a gap between theapertures of the image projector arrangements, leading to acorresponding gap in the coupled-out partial images.

FIG. 2C illustrates schematically an embodiment of a display 70according to the present invention. The display 70 is implemented via acombination of projector assembly 5 a (FIGS. 2A) and projector assembly5 b (FIG. 2B), although in principle there can be more than twoprojector assemblies. Projector assembly 5 a includes image projectorarrangement 20 a and LOE 28 a.

Image projector arrangement 20 a is configured to generate and project afirst partial image corresponding to a first part of the image. Imageprojector arrangement 20 a is deployed to introduce the first partialimage into LOE 28 a so as to propagate the first partial image withinthe LOE by internal reflection from the LOE's pair of parallel externalsurfaces. A coupling-out arrangement 7 a (shown as dashed rectangles onthe LOE) associated with LOE 28 a is deployed to couple-out the firstpartial image from the waveguide towards the eye of the viewer.

Projector assembly 5 b includes image projector arrangements 20 b 1 and20 b 2, and LOE 28 b. Image projector arrangement 20 b 1 is configuredto generate and project a second partial image corresponding to a secondpart of the image. Image projector arrangement 20 b 2 is configured togenerate and project a third partial image corresponding to a third partof the image. Image projector arrangements 20 b 1 and 20 b 2 aredeployed to introduce the second and third partial images, respectively,into LOE 28 b 2 so as to propagate the partial images within the LOE byinternal reflection from the LOE's pair of parallel external surfaces.Coupling-out arrangements 7 b 1, 7 b 2 (shown as dashed rectangles onthe LOE) associated with LOE 28 b are deployed to couple-out the secondand third partial images, respectively, from the waveguide towards theeye of the viewer. Note that coupling-out arrangement 7 a is in practiceassociated with projector assembly 5 a, but shown in FIG. 2C here onprojector assembly 5 b in order to illustrate the overlapping effect ofthe coupled-out partial images. In the embodiment shown in FIG. 2C, thefirst partial image (projected by image projector arrangement 20 a)partially overlaps the second partial image (projected by imageprojector arrangement 20 b 1) and the third partial image (projected byimage projector arrangement 20 b 2). LOEs 28 a and 28 b are deployed inoverlapping relation with respect to one another such that projectorassemblies 5 a and 5 b cooperate to display the image to an eye of theviewer. It should be noted that while LOE 28 a is shown as being locatedbehind LOE 28 b, in principle LOE 28 a could alternatively be in frontof LOE 28 b. Preferably, LOEs 28 a and 28 b should be as close to oneanother as possible, though an air gap, or a layer simulating an airgap, is typically required in order to maintain the light guidingproperties of the LOE. In some embodiments, if the image projectorarrangement is wider than its associated waveguide such that part of theimage projector will extend over the side of the LOE, it is preferableto have image projector arrangements 20 b 1 and 20 b 2 extend overopposing sides of the LOE.

Preferably, the field and aperture continuity as well as pixel intensityuniformity should be maintained when the viewer's pupil is at differentpositions in the eye-box.

While it should be readily apparent from FIG. 2C that the projectorassemblies couple-out overlapping partial images, it may be lessapparent that not all of the overlapping pixels coupled-out to theviewer will illuminate the pupil, as will now be detailed below withreference to FIGS. 2D-2E.

FIGS. 2D and 2E illustrate schematically a cross-sectional top-down viewof projector assemblies 5 a and 5 b, showing partially overlappingpartial images coupled out towards eye-box 14. FIG. 2D shows raydirections corresponding to two pixels in the left half of the overallfield of view, which are generated by projector arrangements 20 a and 20b 1, and coupled-out by coupling-out arrangements 7 a and 7 b 1,respectively. FIG. 2E shows ray directions corresponding to two pixelsin the right half of the overall field of view, which are generated byprojector arrangements 20 a and 20 b 2, and coupled-out by coupling-outarrangements 7 a and 7 b 2, respectively. These pixels have been chosento facilitate an understanding of certain aspects of the presentinvention, but it will be understood that, during use, all pixels of theoverall image are coupled out to the viewer concurrently. Two possiblepupil positions 15 a and 15 b are shown in each of FIGS. 2D and 2E.

FIGS. 2F and 2G correspond to FIGS. 2D and 2E and illustrateschematically selected points (pixels) in the projected fields inangular space as would be observed by a pupil at each of pupil position15 a (shown in FIG. 2F) and pupil position 15 b (shown in FIG. 2G).FIGS. 2F and 2G demonstrate the variance in the perceived imageaccording to the viewer's pupil position.

The terms “overlap region”, “region(s) of overlap”, and “region ofpartial overlap” will now be used to refer to image data that issimultaneously projected by more than one image project arrangement. Asnoted, typically a subset of the pixels within the region of overlapwill illuminate the pupil from both projectors at any given time (theother pixels reaching the eye from only one projector while light fromthe other falls to the left or right of the pupil).

Referring now to FIGS. 2F and 2G, pixels 1000F, 1002F, 2002F and 2000Fare produced by light rays 1000, 1002 a/b, 2002 a/b and 2000,respectively (shown in FIGS. 2D-2E). In FIGS.

2F and 2G, similarly numbered pixels correspond to identical imageinformation, as shown by their being positioned, in both FIGS. 2F and2G, at identical locations within the field of the image.

Referring now to FIG. 2F, pixel 1002F is simultaneously coupled-outtowards the viewer by light ray 1002 a and light ray 1002 b from(originating from image projector arrangements 20 a and 20 b 1,respectively). Both of these light rays illuminate the pupil. On theother hand, pixel 2002F is also simultaneously coupled-out towards theviewer by two light rays, being light rays 2002 a and 2002 b(originating from image projectors 20 a and 20 b 2, respectively).However, in this case, only light ray 2002 b illuminates the pupil.

By contrast, the opposite is true when the pupil is at pupil position 15b, where for pixel 1002F only light ray 1002 b illuminates the pupil,while for pixel 2002F both light rays 2002 a and 2002 b illuminate thepupil.

Thus, for pupil position 15 a, the “selected pixels” within the regionof overlap preferably include pixel 1002F but not 2002F. For pupilposition 15 b, the selected pixels within the region of overlappreferably include pixel 2002F but not 1002F.

Note that at both of pupil positions 15 a and 15 b, neither pixel 1000Fnor 2000F are included in the overlapping region because each of thesepixels originates from one image projector arrangement.

This demonstrates although the overlapping regions of the image arefixed according to the configuration of the projector assemblies,typically only a subset of pixels within the overlapping region willilluminate the pupil from two projectors at a given time based on theviewer's pupil position.

Pixel Intensity Reduction

It should be appreciated that light rays that reach the pupil from twosources will produce pixels having nearly twice the intensity comparedto other pixels produced from one source, leading to a perceivednon-uniformity in the viewed image. To address this non-uniformity, itis desirable to reduce the intensity of these pixels. However, asalready pointed out above, the number of projector arrangements fromwhich illumination arrives at the viewer's pupil for various pixels inthe region of overlap between the partial images will vary according tothe pupil position across the eye-box. An intensity correction accordingto an aspect of the present invention is therefore preferably performedonly on a selected subset of the pixels within the region of overlap ofthe partial images, as will now be detailed.

Therefore, according to some embodiments, the pixel intensity ofselected pixels in regions of overlap are reduced (e.g. via acontroller, as will be further detailed below) so as to enhance theperceived uniformity of the image when viewed by a viewer.

FIGS. 3A and 3D illustrate examples of angular power intensitydistribution (lateral axis only) of the partial images generated by theseparate image projector arrangements 20 b 1, 20 a and 20 b 2(respectively denoted ‘(a)’, ‘(b)’, and ‘(c)’) after a reduction in theintensity of pixels in part of the overlapping regions of the partialimages. FIGS. 3B, 3C and 3E illustrate examples of the lateral angulardistribution of pixel intensities when the partial images are combined.It should be noted that FIGS. 3A-3E illustrate theoretical pixelintensity distribution across the field, while in practice the intensitydistribution of a given projector arrangement is typically non-uniformacross the projected field, and gradually drops off towards the ends ofthe field.

FIG. 3A is optimized for the viewer's pupil being located at pupilposition 15 a (see FIGS. 2D-2H), in which case the subset of the pixelsin image area 50 that reach the central pupil position from twoprojectors are reduced to half the intensity, so that after combiningthe images from all image projector arrangements the pixel intensityreaching the eye will be uniform across the entire image, as shown bythe dashed line in FIG. 3B.

However, if the viewer's eye is repositioned to pupil position 15 b,(see FIGS. 2D-2H), the intensity of the combined image is no longeruniform, as shown in FIG. 3C, due to the change in the subset of pixelsfrom the overlapping regions which reach the eye from two projectors.

The change in pixels which reach the eye due to the different pupilposition was described above with reference to FIGS. 2F-2G, where point1002F went from being viewed from two projectors to being viewed onlyfrom one, whereas point 2002F went from being viewed from one projectorto being viewed from two.

Therefore, according to some embodiments, the controller may vary thesubset of pixels for which the intensity is reduced based on an overlapregion adjustment input, e.g. based on the viewer's anticipated or knownpupil position. In some embodiments, the overlap region adjustment inputmay be derived automatically, e.g. via a pupil sensor. In someembodiments, the overlap region adjustment input may be derived bymanual input from the user. For example, a test image can be displayedto the user with overlapping parts. The user can be asked to look atvarious parts of the image and provide input to reduce the intensity ofselect pixels, such as by actuating a knob or lever coupled to thecontroller, when the image appears uniform. Alternatively, the user canprovide feedback to adjustments made by the controller, for exampleduring a calibration process. The controller receiving such feedback canvary the subset of pixels for intensity reduction until a bestapproximation for a uniform perceived image is achieved.

By way of example, FIG. 3D illustrates the angular power intensitydistribution based on the viewer's eye located at pupil position 15 b,after having reduced the intensity of the pixels corresponding to imagearea 50′. Note that the image area 50′ for pixel intensity reduction inFIG. 3D are somewhat different than the image area 30 in FIG. 3A due tothe different pupil position. After combining the separate images, theintensity across the combined image is made uniform, as shown in FIG.3E.

It should be noted that pupil position changes when the viewer looks indifferent directions, i.e., at different parts of the projected imagedue to rotation of the eye about its center of rotation. Typically, thesensitivity of the human eye to variations in image intensity is muchgreater in the central region of view, while a person is much moretolerant of intensity variations in their peripheral vision.Accordingly, it is typically sufficient to perform an adjustment tooptimize the region of intensity correction for each “seam” (region ofoverlap) for the pupil position which corresponds to an eye directionlooking towards that seam. Thus, for example, the aforementioned manualuser adjustment may advantageously be performed as part of asoftware-guided calibration process in which the user is firstinstructed to look at a projected calibration image spanning a firstseam, e.g., to the left, and to make the manual adjustment until thatcalibration image appears uniform, and then to look at a projectedcalibration image spanning a second seam, e.g., to the right, and tomake the manual adjustment until that calibration image appears uniform.Those settings may then be used continuously for subsequent projectionof images, independent of the instantaneous pupil position, with theunderstanding that the seam regions of the field of view will be at highquality while the user is looking at them with her central vision, andmay be somewhat non-uniform in the peripheral vision.

In some embodiments a pupil sensor can be deployed to dynamically detecteyeball rotation (e.g. as a function of deviation from a predeterminedrotation center). Based on the detected eyeball rotation, the controllercan determine the subset of pixels to be intensity reduced and makeappropriate adjustments, providing full-field uniformity optimizationfor each instantaneous position of the pupil.

FIGS. 4A-4C illustrate schematically cross-sectional views of differentconfigurations of a display according to the present invention.

In some embodiments, the display can include a separate waveguide foreach image projector arrangement. In a particularly preferredembodiment, the display includes three projector arrangements, and threecorresponding waveguides, as shown in FIG. 4A. The three projectorarrangement configuration advantageously allows the middle field,corresponding to the viewer looking at the center of the image (asopposed to looking to the sides) to be generated by the middle projectorarrangement only and generally free of overlap and naturally uniform.Parenthetically, both here and in all other implementations describedherein, the fields of view of the different projector arrangements donot need to be equal. In certain examples, it may be advantageous toprovide a projector arrangement with a relatively larger field of viewfor the central region of the FOV, while the lateral regions of theoverall FOV may be provided by projector arrangements that project asmaller FOV.

FIG. 4B illustrates schematically an alternative embodiment where twoprojector arrangements are used with corresponding waveguides. Thisconfiguration advantageously is relatively simpler to manufacture (aswell as operate) due to the reduced number of components. In addition,in this configuration there is advantageously only a single overlappingregion that requires intensity adjustment of the pixels therein, asopposed to the three projector arrangement configuration which producestwo different overlapping regions. Use of differing sized FOV for thetwo projectors may allow offsetting of the seam region outside thecentral region.

FIG. 4C illustrates schematically an embodiment having non-parallelwaveguides 41 a, 41 b and 41 c, which can further expand the image fieldby orienting the waveguides to extend around or partially encompass theobserver (or an eye of the observer). It should be noted that in thisembodiment, the edges of the waveguides may be within the field of viewof the observer, and might therefore cause a scattering and/orperturbation effect in the viewed image. These effects can be at leastpartially suppressed or eliminated by introducing an index-matchedmedium 43 (e.g. such as conformal plastic) between these edges therebyforming an optically smooth transition with the edges of the LOE.

This embodiment can be further extended to multiple light guide panelsencompassing any desired angle around the observer, and optionallyreplicated in two dimensions to provide an overall concave display,which could be extended to form a viewing dome or the like.

FIG. 5A illustrates schematically an embodiment of a display configuredfor 2D image expansion. In this embodiment, the display has twoprojector arrangements 24 and 26 deployed to couple-in partial images toa single 2D LOE 28 for 2D image expansion. LOE 28 has two non-parallelsets 30, 32 of mutually parallel facets or diffractive elements. LOEsconfigured for 2D image expansion are further described in WO2019/016813 (see, e.g., FIGS. 5A, 6 of that publication).

Projector arrangements 24, 26 project images at two different anglesinto LOE 28. The light from both projector arrangements is firstreflected by facets 30 (thereby expanding aperture in one dimension,e.g. vertically) and subsequently reflected by facets 32 outward towardthe observer while simultaneously expanding the aperture in the otherdimension, e.g. horizontally. Each projector arrangement generates apartial image, which is then coupled-out to the viewer such that theviewer sees a combined image. Note that the region of overlap betweenthe partial images may be a side-by-side horizontal arrangement as shownin FIG. 5B or a top-bottom vertical arrangement as shown in FIG. 5C. Theangle of horizontal or vertical tilt between the projector arrangements24 and 26 determines the offset between the optical axes of the twoprojectors, and hence the degree of vertical and horizontal overlapexists in the image viewed by the observer. Note that the actualpositioning of the projector arrangements 24 and 26 is typically notcritical because two-dimensional aperture expansion is performed byfacets 32 and 30 on light from both projector arrangements. Note that inthe overlapping region of the field, the intensities projected by thetwo projector arrangements must be managed in order to maintain uniformintensity. In this case, variations of intensity across the eye-box willbe reduced relative to the multiple waveguide configuration.

FIG. 6 illustrates schematically a second embodiment of a displayconfigured for 2D image expansion. This embodiment uses four projectorarrangements. Projector 34 couples-in to LOE 28 partial images forreflection and aperture expansion by facets 30 and then reflection onlyby facets 32. On the other hand, projector arrangement 36 couples-in toLOE 28 partial images for reflection and aperture expansion by facets 32and then reflection only by facets 30.

Projector arrangement 38 is oriented to reflect primarily from facets 32while projector arrangement 40 is oriented for reflection primarily fromfacets 30. Light from both projector arrangements 38 and 40 experiencesome back-and-forth reflection between the perpendicular sets of facets30, 32 causing aperture expansion in both the vertical and horizontaldimensions.

FIG. 7 illustrates schematically an example functional block diagram ofa display in accordance with certain embodiments. Display 70 includescontroller 74, and two or more projector assemblies 5-1-5-n.

Each projector assembly 5 includes at least one image projectorarrangement 20, and at least one LOE 28 having a pair of parallelexternal surfaces. Image projector arrangement 20 is configured togenerate and project a partial image and is deployed so as introduce thepartial image to LOE 28. LOE 28 is configured to propagate the partialimage within the LOE by internal reflection from the pair of parallelexternal surfaces. In some embodiments, each projector assembly includesa coupling-out arrangement 7 associated with LOE 28 and configured forcoupling-out the partial image from the LOE towards the eye of theviewer. In some embodiments, the LOEs 28 of respective projectorassemblies are deployed in overlapping relation with one another suchthat each projector assembly projects a respective partial imagecorresponding to a respective part of the image to be displayed to theviewer. The respective parts of the image have partial overlap so thatthe two or more projector assemblies cooperate to display the image tothe viewer.

Controller 74 is associated with the image projector arrangements ofeach projector assembly. Controller 74 includes at least one processor76 associated with a memory 78. Processor 76, in combination withassociated memory 78, is configured to execute one or more functionalmodules stored in memory 78 for controlling display 70, including, e.g.reducing a pixel intensity of selected pixels projected by at least oneimage projector arrangement, the selected pixels being in a region ofpartial overlap between parts of the image, so as to enhance theperceived uniformity of the image displayed to the viewer.

In some embodiments, the controller may be configured to vary the pixelintensities of selected pixels in the region of overlap taking intoaccount any variance in the projector arrangements' pixel intensitiesprojected across the field and the viewer's pupil position within theeye-box.

In some embodiments, the controller may be configured to graduallyreduce the intensity of the selected pixels projected by one projectorarrangement across the region of partial overlap, and to graduallyincrease the intensity of the selected pixels projected by the secondprojector arrangement across the region of partial overlap.

In some embodiments, controller 74 may be coupled to a user input device(not shown) configured for providing user input to controller 74, forexample as described above with reference to FIGS. 3A and 3D. In someembodiments, the controller may be physically located within the samehousing or different housing than other components of display 70. Insome embodiments, different components of the controller may bephysically located apart from one another. In some embodiments, thecontroller is preferably implemented in, but not limited to, ahead-mounted display, and most preferably in an eye-glasses form factor.

In some embodiments, display 70 further includes a pupil sensor 72configured to detect a current pupil position of the viewer, and toupdate the controller 74 with data indicative of current pupil position.

In some embodiments, controller 74 is configured to determine a subsetof common pixels between the partial images, based on the data obtainedfrom the pupil sensor or based on a user input, for which imageillumination is arriving at the pupil from two projectorssimultaneously, and to implement intensity reduction for that subset ofpixels. In some embodiments, the controller is further configured tovary the selection of the subset of common pixels in response to anoverlap region adjustment input. The overlap region adjustment input canbe derived from the pupil sensor, or from manual user input.

In some embodiments, the controller can be configured to obtaincalibration data in cooperation with pupil sensor 72 and store theobtained calibration data in memory 78, and determine the appropriateoverlap region adjustment for every pupil position based on the storedcalibration data.

FIG. 8 illustrates an example flow-chart of a method for displaying animage to an eye of a viewer in accordance with certain embodiments wherea sensor is used to detect pupil position of the viewer, either as aone-time calibration process or for ongoing real time adjustment. Allsteps are performed by processor 76 unless otherwise noted.

At step 86, the pupil sensor detects the pupil position of the viewer'seye.

At step 88, at each different pupil position, determine a subset ofpixels in the overlapping region of the image displayed to the viewer.

At step 90, the intensity of pixels within the determined subset isreduced so as to enhance the uniformity of the image displayed to theeye of the viewer. This intensity reduction is typically performed bymodifying the image data sent to the projector, reducing the pixelintensity values for the relevant subset of pixels which are sent toboth projectors. For example, a pixel with RGB values of (200,80,168)from the region of perceived overlap could be sent to both projectors asif the pixel data were a dimmer pixel of the same color, such as(100,40,84), assuming ideal linear response of the projector. Inpractice, the correction may need to be calibrated according to thespecific hardware properties of the projector assemblies. Additionally,as described above, the output intensity of the different projectorassemblies are typically not uniform across the field, and intensitycorrection should preferably take into account these non-uniformities.

Although the intensity reduction profile has been illustrated herein asa step function, with 50% intensity being contributed by each projectorin the region of perceived overlap, it should be noted that thesubdivision of intensity between the two projectors need not be equalfor any given pixel, and that the smoothness of the resulting image willtypically be greatly enhanced by use of a linear tapering, or anotherwise smoothed transition profile.

FIG. 9A illustrates an embodiment where the visible image intensityprogressively hands-off between each two adjacent projectors across theregion of perceived overlap, preferably starting at more than 80%intensity at the beginning of the region of perceived overlap, passing50:50 somewhere in the middle, and reaching less than 20% contributionto the relevant pixel intensity at the outer extremity of theperceived-overlapping pixels for each projector. This progressivevariation is preferably monotonic and occurs gradually across thetransition area.

FIG. 9B illustrates the intensity distribution in the combined mageafter the correction by linear tapering as described in FIG. 9A. In someembodiments, if intensity correction is performed by linear or othergradual tapering as described above, preferably with a more gentle slopeand over a larger transition area, the corrected image may be wellwithin acceptable limits for viewing at any pupil position, therebyobviating the need to detect pupil positon and perform dynamiccorrection, as illustrated in FIG. 9C. In the case of a manual userinput to adjust the intensity reduction regions, the intensity reductionprofile may advantageously be temporarily switched to the step functionprofile during calibration in order to render the intensitynon-uniformity more noticeable, and then switch back to a progressivevariation during normal operation. In addition, in cases where theprojector arrangements are of the type having gradual spatial intensityattenuation, the progressive intensity degradation described here can bemodified according to the attenuation characteristics of the respectiveprojector arrangements, as well as the pupil position within theeye-box, in order to maintain a uniform image intensity as viewed by aneye.

It should be appreciated by those skilled in the art that the displaysprovided herein may be implemented both in virtual reality and inaugmented reality applications (i.e. where virtual display elements arecombined with a direct view of the real world).

It will be appreciated that the above descriptions are intended only toserve as examples, and that many other embodiments are possible withinthe scope of the present invention as defined in the appended claims.

1-6. (canceled)
 7. A display for providing an output image to an eye ofa viewer, the display comprising: (a) a first light-guide opticalelement (LOE) having a pair of parallel external surfaces; (b) first andsecond image projector arrangements generating respectively first andsecond partial images, said first and second image projectorarrangements being deployed to introduce the first and second partialimages into said first LOE so as to propagate within said first LOE byinternal reflection at said pair of external surfaces; (c) a firstcoupling-out arrangement associated with said first LOE and configuredfor coupling out the first and second partial images so as to directsaid first and second partial images towards the eye of the viewer; (d)a second LOE having a pair of parallel external surfaces, said secondLOE being deployed in overlapping relation with said first LOE; (e) athird image projector arrangement generating a third partial image, saidthird image projector arrangement being deployed to introduce the thirdpartial image into said second LOE so as to propagate within said secondLOE by internal reflection at said pair of external surfaces; and (f) asecond coupling-out arrangement associated with said second LOE andconfigured for coupling out the third partial image so as to direct saidthird partial image towards the eye of the viewer, wherein said firstand second partial images provide non-overlapping subregions of theoutput image, and wherein said third partial image provides a centralsubregion of said output image partially overlapping with each of saidfirst and second partial images, said first, second and third partialimages contributing to a continuous output image as viewed by the eye ofthe viewer.
 8. The display of claim 7, further comprising a controllerhaving at least one processor, said controller being associated withsaid first, second and third image projector arrangements, andconfigured to reduce a pixel intensity of selected pixels projected byat least one of said first, second and third image projectorarrangements, said selected pixels being in regions of said partialoverlap between said third partial image and said first and secondpartial images so as to enhance a perceived uniformity of the outputimage.
 9. The display of claim 8, wherein the controller is configuredto gradually reduce the intensity of said selected pixels projected bythe first and second projector arrangements across said regions ofpartial overlap, and to gradually increase the intensity of saidselected pixels projected by the third projector arrangement across saidregion of partial overlap.
 10. The display of claim 7, wherein each ofsaid first and second coupling-out arrangements is implemented as one ormore sets of obliquely-angled, mutually-parallel internal partiallyreflecting surfaces deployed within said first or said second LOE,respectively.
 11. The display of claim 7, wherein each of said first andsecond coupling-out arrangements is implemented as a diffractive opticalelement.